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Abstract 

Introduction: IS0 15189 was a new standard published in 2003 for accrediting medical laboratories. We believe that some requirements of the ISO 
15189 standard are especially difficult to meet for majority of laboratories. The aim of this article was to present the frequency of nonconformities 
to requirements of the IS0 15189 accreditation standard, encountered during the assessments of medical laboratories in Hong Kong, during 2004 to 
2009. 

Materials and methods: Nonconformities reported in assessments based on IS0 15189 were analyzed in two periods - from 2004 to 2006 and in 
2009. They are categorized according to the IS0 15189 clause numbers. The performance of 27 laboratories initially assessed between 2004 and 2006 
was compared to their performance in the second reassessment in 2009. 

Results: For management requirements, nonconformities were most frequently reported against quality management system, quality and te- 
chnical records and document control; whereas for technical requirements, they were reported against examination procedures, equipment, and 
assuring quality of examination procedures. There was no major difference in types of common nonconformities reported in the two study periods. 
The total number of nonconformities reported in the second reassessment of 27 laboratories in 2009 was almost halved compared to their initial 
assessments. The number of significant nonconformities per laboratory significantly decreased (P = 0.023). 

Conclusion: Similar nonconformities were reported in the two study periods though the frequency encountered decreased. The significant decrea- 
se in number of significant nonconformities encountered in the same group of laboratories in the two periods substantiated that IS015189 contribu- 
ted to quality improvement of accredited laboratories. 
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Introduction 

Before the publication of the international stand- 
ard ISO 15189 for accreditation of medical labora- 
tories, there was no official accreditation system 
for accrediting medical laboratories in Hong Kong. 
There are over 100 medical laboratories in Hong 
Kong including a large number of private labora- 
tories as well as many in the public hospitals ad- 
ministered under the Hospital Authority, neverthe- 
less, medical laboratories in Hong Kong are not re- 
quired to be registered with the health authority 
or accredited for their operation. Standards of 
many medical laboratories in Hong Kong are of 



high quality and are well recognized by the inter- 
national medical community through the regular 
participation of their staff in international confer- 
ences and publications in peer reviewed journals 
by the medical professionals of Hong Kong. 

Hong Kong Accreditation Service (HKAS) is the 
only government run accreditation body in the 
economy but it did not offer accreditation for 
medical testing laboratories before 2004. HKAS 
has over 20 years of experience in providing ac- 
creditation to the non-medical testing laboratories 
and calibration laboratories and is a signatory to 
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the mutual recognition arrangement of Interna- 
tional Laboratory Accreditation Cooperation (ILAC) 
and Asia Pacific Laboratory Accreditation Cooper- 
ation (APLAC). Before the introduction of the ac- 
creditation programme for medical laboratories in 
2004, laboratories were accredited using ISO/IEC 
17025 and these did not include the medical test- 
ing laboratories. Some large hospital laboratories 
that enjoy international reputation sought profes- 
sional recognition of their competence through 
accreditation by overseas accreditation bodies 
such as College of American Pathologists (CAP) or 
National Australian Testing Authorities (NATA) that 
have a long history of accrediting medical labora- 
tories. Internationally, ISO/IEC 17025 has not been 
well accepted by the medical community as suita- 
ble for accrediting medical laboratories and so the 
ISO technical committee TC212 was given the task 
to draft a standard particularly for medical labora- 
tories. Since IS015189 first published in 2003, it has 
been widely used as the accreditation standard for 
medical laboratories internationally by various ac- 
creditation bodies (1-5). In 2004, the laboratory ac- 
creditation programme of HKAS was extended to 
cover medical testing laboratories using the new 
accreditation standard soon after its publication. 

At that time accreditation is a new concept to most 
medical testing laboratories in Hong Kong. Most 
laboratories did not operate a management sys- 
tem before 2004. Medical laboratory practitioners 
were not accustomed to writing down their opera- 
tions and the concept of record traceability was 
not fully understood. Internal auditing was un- 
heard of. Though internal quality controls were 
run in routine testing and external quality assur- 
ance programmes were participated by most lab- 
oratories, the practice and frequency of participa- 
tion varied greatly from laboratory to laboratory. 
Evaluation of new methods and new autoanalys- 
ers were carried out to various extents by large 
laboratories, while for small laboratories, new 
equipment at times were used immediately after 
installation without any method validation. Since 
the launching of the accreditation programme, 
laboratory personnel were trained in ISO 15189, 
and throughout the last few years, there had been 



obvious improvements in meeting the ISO 15189 
requirements. 

ISO 15189 is an accreditation standard prepared 
particularly for the medical laboratories. This 
standard is expected to help medical laboratories 
in raising the quality of services provided. 

The aim of this study was to assess whether ISO 
15189 contributed to the quality improvement of 
medical laboratories in Hong Kong and the labora- 
tories had found particular difficulties to comply 
with which requirements of ISO 15189. The fre- 
quency of nonconformities (NCs) to requirements 
of the ISO 15189 accreditation standard, encoun- 
tered during the assessments of medical laborato- 
ries in Hong Kong, during 2004 to 2009, was ana- 
lyzed. This would show which are the more diffi- 
cult requirements found by most laboratories and 
shorten the learning path of the medical laborato- 
ries. By looking at the change in number of NCs 
encountered in subsequent assessments of the 
same group of laboratories, the effectiveness of 
this new standard in improving the quality of ac- 
credited laboratory service is reviewed. 

The types and number of NCs reported by the as- 
sessment teams in assessments of medical labora- 
tories accrediting to ISO 15189 were reviewed in 
two periods and their performances were com- 
pared. The medical accreditation programme of 
HKAS started in 2004, the number of application 
for accreditation went slow in the first two years as 
the laboratories got themselves prepared but 
sharply increased in the third and fourth year. Data 
from 73 assessments in 2009 were compared to 
data obtained in an earlier period (2004-2006) 
when the accreditation programme was at its early 
stage. Hong Kong is an ideal place to demonstrate 
the usefulness of accreditation to ISO 15189 in rais- 
ing the quality of services provided as accredita- 
tion is not mandatory in our community and it is 
not related to insurance claims. Improvement and 
changes are all self-initiated. Because accreditation 
is a new concept to most laboratories, they are ex- 
cited to set up a management system that could 
meet international standards and they eagerly im- 
prove themselves in order to be accredited and 
recognized. 
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Materials and methods 

Study design and data collection 

The data for this retrospective observational study 
were retrieved from 2004 to 2009. From 2004 to 
2006, HKAS had conducted assessments of 40 lab- 
oratories of different pathology disciplines using 
ISO 15189:2003 (6). Number of NCs reported were 
counted and categorized into "significant" or "mi- 
nor" grading or reported as "recommendations" in 
each assessment. The number of NCs in each cate- 
gory reported during the assessments was grouped 
according to the clause number of ISO 15189 and 
their frequency of occurrence was presented as per- 
centage of total no. of NCs reported for the labora- 
tories assessed in the study period. Performance of 
the laboratories was presented in terms of average 
number of NCs per laboratory. Data collected from 
2004 to 2006 represented performance of laborato- 
ries undergoing the first few assessments and are at 
learning phase of the ISO 15189 requirements. 

In 2009, the number of laboratories assessed 
against requirements of ISO 15189:2007 (7) in- 
creased to 73. Similar types of data (total no. of 
NCs reported; the frequency of occurrence of NCs 
to requirements of ISO 15189 in terms of counts 
and percentages; and average number of NCs per 
laboratory for each category) were collected from 
these 73 laboratories assessed in 2009. Among 
these 73 laboratories, 61 of them had been accred- 
ited before 2008 (included those laboratories be- 
ing initially assessed from 2004 to 2006), and were 
either having their surveillance visits or reassess- 
ments in 2009, whereas 12 laboratories had their 
initial assessments in the year. Among the 61 ac- 
credited laboratories, 27 were having their second 
reassessments in 2009, hence data collected from 
these 27 laboratories represented a more mature 
phase of implementing the management system 
established in accordance with the ISO 15189 re- 
quirements after being accredited for a few years. 
The performance of these 27 laboratories, in terms 
of number of NCs per laboratory, in their initial as- 
sessment was compared with their performance 
in the second reassessment in 2009. These figures 
would indicate whether accredited laboratories 
had any improvement in the quality of services 
provided after accreditation. 



Nonconformities included in this study were either 
graded as significant or minor 
A significant nonconformity is one which has seri- 
ous adverse effect on the validity of an activity, its 
results or the competence of the organization or a 
deliberate violation of HKAS regulations for ac- 
creditation. For instance, when it is a widespread 
phenomenon that operating procedures are not 
documented and/or staff do not perform their 
tests in accordance with the documented proce- 
dures, a significant NC would be reported against 
clause 4.2 (quality management system). When a 
method was not evaluated to the extent as neces- 
sary to demonstrate its suitability for the intended 
use, a significant NC would be reported against 
clause 5.5. Significant NCs have to be corrected 
with documented evidence before accreditation is 
granted or reaffirmed. 

NCs with no serious adverse effect on the validity 
of the activity, its results or the competence of the 
organization can be classified as minor. For in- 
stance, equipment was calibrated but the calibra- 
tion label had not been updated with the calibra- 
tion status or the laboratory failed to monitor the 
quality indicator established. Minor NCs also have 
to be corrected; and action plans have to be pro- 
vided within one month after assessment, but the 
effectiveness of actions taken would be checked 
in the next assessment visit. Recommendations 
are those that are mainly good laboratory practic- 
es and laboratories may select to accept or reject 
the recommendations. For instance, phone report- 
ing of critical results was found recorded on the 
back of the test request form, a more systematic 
way to record details of the reported results and 
the parties involved in the communication would 
be recommended for better record traceability. 

Data collected from the periods of time mentioned 
above were analyzed according to the number 
and nature of NCs reported during the assessment 
visits, and the frequency of occurrence of NCs 
against each ISO 15189 requirement. In addition, 
the number of NCs reported per laboratory for the 
27 laboratories undergoing their second reassess- 
ments was compared with the number reported 
in their initial assessments. 
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Statistical analysis 

The Kolmogorov-Smirnov test was used to assess 
the normality of distribution of investigated pa- 
rameters (i.e. number of NCs per laboratory in each 
grading reported in the initial and second reas- 
sessment of the 27 laboratories). Apart from the 
number of significant NC reported from the initial 
assessments of the 27 laboratories assessed in be- 
tween 2004 and 2006 was not distributed normal- 
ly, the other parameters were distributed normally. 
Selection of appropriate statistical methods was 
based on a recent publication by Simundic AM (8). 
Wilcoxon matched-pairs signed rank test was used 
to analyze if there was any significant differences 
between the performance of the 27 laboratories in 
terms of no. of NCs per laboratory encountered in 
their initial assessments and their second reassess- 
ments (8). P values < 0.05 were considered statisti- 
cally significant. Statistical analysis was done using 
GraphPad Prism version 5.0 (GraphPad Software 
Inc., California, USA). 

Results 

Common nonconformities found against 
management requirements 

The overall distribution of NCs per laboratory 
against different requirements of ISO 15189 found 



in the assessments from 2004 to 2006 was shown 
in Figure 1, whereas those found in the assess- 
ments in 2009 were shown in Figure 2. Data shown 
in Figure 1 were collected from all 40 laboratories 
assessed from 2004 till 2006, including data of the 
27 laboratories undergoing initial assessments 
from 2004 to 2006 while those in Figure 2 were 
collected from 61 laboratories undergoing reas- 
sessments or surveillance visits in 2009. Since a 
comparison of the total number and distribution 
of nonconformities against each clause in Figure 1 
and 2 would provide a general picture on whether 
laboratories had improvement after accreditation, 
data from the 12 laboratories that had initial as- 
sessments in 2009 were not included in Figure 2. 

Regardless of the accreditation history of the labo- 
ratories, the average number of NCs identified per 
laboratory reduced from 15.4 to 11.1 in the two pe- 
riods (Table 1). For management requirements, the 
most common NCs were found against clauses 4.2 
- Quality management system, 4.3 - Document 
control, 4.6 - External services and supplies and 
4.13 - Quality and technical records in the assess- 
ments conducted in 2009, all were more or less re- 
lated to documentation. Apart from an increase in 
number of NCs reported against clause 4.6 in 2009, 
similar NCs had also been reported against these 
management requirements in the earlier assess- 
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Figure 1. Distribution of nonconformities. S - significant nonconformities; M - minor nonconformities reported against management 
and technical requirements of ISO 15189:2003 in assessment of 40 laboratories conducted from 2004 to 2006. 
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Figure 2. Distribution of nonconformities. S - significant nonconformities; M - minor nonconformities reported against management 
and technical requirements of ISO 15189:2007 in reassessment and surveillance visits of 61 laboratories conducted in 2009. 



Table 1. Number of nonconformities (NCs) reported in assessments conducted from 2004 to 2006 and in 2009. 





2004-2006 




2009 




Nature of assessments 


All types of 


Reassessments + 


Initial 


All types of 




assessments 


Surveillance visits 


assessments 


assessments 




N = 40 


N = 61 


N = 12 


N = 73 


Total number of NCs# 


616 


580 


233 


813 


Number of NCs per laboratory 


15.4 


9.5 


19.4 


11.1 


# Nonconformities (NCs) are either significant or minor, exclud 


ng recommendations 







N = Number of laboratories assessed 



merits from 2004 to 2006 (Table 2). Table 2 com- 
pared the performance of laboratories against the 
same requirement clause in the two periods. Those 
laboratories undergoing their initial assessments 
in 2009 were separately listed in Table 2. A de- 
crease in number of NCs per laboratory was re- 
ported against clause 4.2 and clause 4.13 while a 
rise was reported against clause 4.6 in 2009 assess- 
ments of laboratories accredited before 2008. For 
the 12 laboratories undergoing their initial assess- 
ments in 2009, high numbers of NCs were also re- 
ported against these management requirements. 

Nonconformities against Clause 4.2 - Quality 
Management System 

Clause 4.2.1 stated that "Policies, processes, pro- 
grammes, procedures and instructions shall be 



documented and communicated to all relevant 
personnel. The management shall ensure that the 
documents are understood and implemented. 
Laboratories were often found to carry out tests 
deviated from the documented procedures; and 
there were often procedures, steps or interpreta- 
tion not described in the documented procedures. 
If documented procedures are not followed, this 
would imply that documents are not well under- 
stood and not the same procedures are imple- 
mented by all staff. There were also situations 
when procedures were thought to be well under- 
stood by all staff and hence they were not docu- 
mented, nevertheless, different staff was found to 
carry out the same procedure with slight variation. 
Under these circumstances, when procedures are 
not documented and resulted in inconsistencies, 
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Table 2. Most common nonconformities reported against management and technical requirements of ISO 15189 in two study peri- 
ods (from 2004 to 2006 and in 2009). 



Most common nonconformities 

Order of occurrence Number of NCs per laboratory 

Clause Number < A - B% ) 







2004-2006 


2009 


2009 


2004-2006 


2009 


2009 






N = 40 


N = 61* 


N = 12** 


N = 40 


N = 61* 


N = 12** 




4.2 Quality Management System 


1 

(61, 10%) 


1 

(73, 13%) 


1 

(35, 15%) 


1.5 


1.2 


2.9 


Management 


4.13 Quality and technical records 


2 

(19,3%) 


4 

(23, 4%) 


2 

(22, 9%) 


0.5 


0.4 


1.8 


requirements 


4.3 Document control 


3 

(18, 3%) 


3 

(29, 5%) 


3 

(9, 4%) 


0.5 


0.5 


0.8 




4.6 External services and 


4 


2 


3 


0.1 


0.5 


0.8 




supplies 


(5, 1%) 


(30, 5%) 


(9, 4%) 




5.5 Examination Procedures 


1 

(136,22%) 


1 

(96, 17%) 


2 

(29, 12%) 


3.4 


1.6 


2.4 


Technical 
requirements 


5.3 Equipment 


2 

(85, 14%) 


2 

(92, 16%) 


1 

(32, 14%) 


2.1 


1.5 


2.7 




5.6 Assuring quality of 


3 


3 


3 


1.8 


1.4 


2.1 




examination procedures 


(72, 12%) 


(88, 15%) 


(25, 11%) 



(A, B%) = Figures in brackets are total number of NCs, including significant and minor nonconformities; and percentage of NCs 
reported against the specified clause number. 
N - number of laboratories assessed 

* 61 laboratories underwent reassessment or surveillance visit; and among these 61 laboratories, 27 had their second 
reassessments in 2009. 



12 laboratories underwent initial assessments in 2009 



this indicated a lack of communication among 
staff. 

Nonconformities against Clause 4.3 - Document 
control 

Before accreditation, laboratories are not used to 
having document control. There were posted in- 
structions or notes as reminders to staff for inter- 
pretation criteria or for certain essential steps, nev- 
ertheless, these are instructions that could affect 
the quality of test results, they also have to be con- 
trolled but were not realized by laboratory staff in 
the early phase of management system imple- 
mentation. Obsolete versions of controlled docu- 
ments were found being used by staff, illustrating 
that they were still not used to the concept of doc- 
ument control. There were also forms and work- 
sheets that had been used for years that were 
found to be not controlled. Instructions to patients 
for sample collection were distributed at the sam- 
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pie collection centers and they were slipped out of 
the document control system. Occasionally, in- 
structions contained therein were found different 
from the controlled sample collection manual. Test 
kit inserts also formed part of the quality docu- 
mentation system and should be controlled for 
use. Most laboratories retained test kit inserts for a 
defined period of time for reference. Nevertheless, 
there was no record on when that particular ver- 
sion of kit insert was used in the laboratory. This 
lack of period of use would cause problem in 
record traceability in case investigation was re- 
quired for NCs identified. Another common obser- 
vation was on the requirement to regularly review 
all documents that formed the management sys- 
tem. Quality documents were recorded as re- 
viewed, but there were obvious errors or obsolete 
information not updated. Records were sometimes 
seen to be amended by staff without initial and 
date. These observations were all related to docu- 
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ment control and were usually reported as minor 
NCs to the laboratories. The improvement in docu- 
ment control was not obvious when comparing 
laboratory performance in the two periods (0.45 
NC per laboratory c.f. 0.48 in Table 2). As the man- 
agement system becomes mature, it is envisaged 
that the occurrence of such NCs would decrease, 
but obviously it takes time for staff to get used to 
the system and change their quality mindset. 

Nonconformities against clause 4.6 - External 
services and supplies 

The number of NCs per laboratory reported 
against Clause 4.6 increased in 2009 (Table 2) be- 
cause laboratories were assessed against require- 
ments of ISO 15189:2007 in which the clause 4.6.3 
required an inventory record system to include de- 
tails of lot number, expiry date, date in use, etc. In 
the 2003 version, this is not a mandatory require- 
ment. Inventory records were found to be incom- 
plete with no recording of the date that a particu- 
lar lot was put into service. It was a common prac- 
tice that laboratories recorded date of opening on 
the box of the test kit, but when the box was dis- 
carded after being used up, the record was lost 
and this could not fulfill the requirement of keep- 
ing the in-use date in the inventory record. There 
were times when evaluation of new lot of reagents 
were done by parallel testing with the old lot, 
there was no defined acceptance criteria or the cri- 
teria established were inappropriate. The verifica- 
tion protocol was not documented, this resulted in 
different number of samples used in each evalua- 
tion and the results of evaluation were interpreted 
with slightly different criteria by different staff. 

Nonconformities against clause 4.13- Quality and 
technical records 

The laboratory is required to retain records related 
to the management system and examination re- 
sults. These include all the laboratory workbooks 
or sheets, raw observations, calculations, etc. A 
common observation is that interpreted results 
were recorded instead of the raw observations 
such as scoring, color reactions, fluorescence, ac- 
tual reactions observed in tubes of different dilu- 
tions, etc. Operators could not be identified from 



the retained records and the supervisor who coun- 
terchecked the results was not recorded. 

Common nonconformities against the 
technical requirements 

A comparison on the number of NCs reported 
against the 8 technical requirements for the as- 
sessments conducted from 2004 to 2006 and in 
2009 showed that NCs were reported against simi- 
lar areas. Clause 5.3 - Laboratory equipment, 
clause 5.5 - Examination procedures and clause 
5.6 - Assuring quality of examination procedures 
were consistently the three most common techni- 
cal areas where NCs were found (Table 2). In gen- 
eral, more number of nonconformities was report- 
ed against the technical requirements than the 
management requirements (Figure 1 and 2). 

Nonconformities against clause 5.3 - Laboratory 
Equipment 

NCs were commonly reported against laboratory 
equipment, nevertheless, these are NCs easily cor- 
rected. Equipment used in the laboratory was re- 
quired to be calibrated against a well calibrated 
reference equipment to attain metrological trace- 
ability. Before the era of accreditation, general 
equipment used in medical laboratories e.g. ther- 
mometers, balances, etc. were often not calibrat- 
ed. They might have maintenance but were often 
not properly calibrated. In the early phase of ac- 
creditation, laboratories might employ a non-ac- 
credited laboratory to calibrate its equipment; or 
wrongly employ an accredited calibration labora- 
tory to calibrate its equipment without noticing 
that the required calibration test was not on the 
laboratory's accredited scope; or purchase equip- 
ment that came with a "calibration" certificate 
from the manufacturer, believing that it is an ac- 
ceptable calibration certificate. There were situa- 
tions where maintenance/calibration was carried 
out by a contractor, the records of which did not 
include any information on what parameters had 
been checked and calibrated. Equipment labels 
were not updated after calibration or maintenance 
being conducted. Usually these observations were 
graded as minor NCs and once being pointed out, 
laboratories quickly learned. 
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Nonconformities against clause 5.5 - Examination 
procedures 

The top number of NCs was reported against 
clause 5.5.2 where laboratories have to validate 
procedures for confirming that the examination 
procedures are suitable for the intended use and 
that the validations shall be as extensive as are 
necessary to meet the needs in the given applica- 
tion or field of application. New autoanalysers 
were found putting into service before they were 
adequately evaluated. The number of patient sam- 
ples used for evaluation was too few in some stud- 
ies and the statistical method used for analysis was 
inappropriate (9) Evaluation reports did not con- 
sist of sufficient detailed information on the proce- 
dures and types of samples used, and acceptance 
criteria were not clearly defined. Some manufac- 
turer's claims were adopted without verification. 
Not only clause 5.5.2 is the most common require- 
ment that non-conformity is found, NCs reported 
are usually of significant nature as an inadequately 
evaluated method could affect the quality of test 
results. 

Another common observation is on the validation 
of reference intervals. Reference intervals are re- 
quired to be reviewed regularly. There were cases 
where manufacturer's reference intervals were 
adopted without validation; or previously estab- 
lished biological reference intervals were adapted 
to the new equipment without validation. Some 
biological reference intervals had been used for a 
long time, while the source was unknown; they 
were applied to the new equipment without any 
validation. 

Nonconformities against clause 5.6 - Assuring 
quality of examination procedures 

Clause 5.6.1 required the laboratory to establish an 
internal quality control system that verifies the at- 
tainment of the intended quality of results, so that 
mistakes are eliminated. Very often, in chemical 
pathology and haematology laboratories, West- 
gard QC rules are used for daily quality control 
monitoring. However, the documented QC rules 
were not followed. The most common observation 
being that when QC rules failed, actions taken by 
the laboratory to address these quality control fail- 
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ure incidents were not recorded and there was no 
record whether patient results had been reviewed. 
Another common observation was that the manu- 
facturer's given mean and standard deviation of a 
quality control material was used as the laborato- 
ry's daily quality control range, this range was of- 
ten too wide and inadequate to monitor the labo- 
ratory's own performance. The control levels used 
sometimes did not cover the clinical decision level 
and the frequency of running quality controls was 
insufficient to monitor the autoanalyser perform- 
ance. The use of third party quality control materi- 
als was always recommended when they were not 
being used by the laboratories. These observa- 
tions were more commonly associated with chem- 
ical pathology and haematology laboratories. 

Laboratories are required to participate in external 
quality assessment programmes and to handle 
EQAP samples in the same way as patient samples 
(10). EQAP samples sometimes were found han- 
dled with special treatment and sometimes con- 
sensus results were reported, particularly for ana- 
tomical pathology. When unsatisfactory results 
were returned, review was superficial and did not 
include any actions taken to address the root cause 
of failure; or observed trends were ignored. 

Comparison on performance of laboratories at 
their initial assessments and their reassessments 

In order to have objective evidence on the im- 
provement brought by implementing a manage- 
ment system meeting the ISO 15189 requirements, 
we compared the number of NCs identified in 27 
laboratories during their initial assessments with 
their second reassessments conducted around 3.5 
to 4 years after establishing their management 
system. The comparison results on the average 
number of NCs reported per laboratory are pre- 
sented in Table 3. 

Discussion 

When comparing assessments conducted in the 
early days when the accreditation programme was 
first implemented, i.e. those conducted from 2004 
to 2006; with assessments conducted in 2009, it 
was found that most common NCs were reported 
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Table 3. Comparison of performance of 27 laboratories in initial assessments and in their second reassessments. 





Initial assessments 


Second reassessments 






2004 to 2006 




2009 




Grading 


N = 27 




N = 27 


P 




ii NCs per 
No. of NCs , , r 

laboratory 


No. of NCs 


NCs per 
laboratory 




Significant (S) 


76 3.2 


18 


0.7 


0.023 


Minor (M) 


295 10.4 


151 


5.9 


0.080 


Total 


371 13.5 


169 


6.6 


0.032 


N - No. of laboratories assessed; NC - nonconformity 



against similar management and technical require- 
ments (Figure 1 and Figure 2). For management re- 
quirements, the most common areas where NCs 
were reported were clause 4.2 - quality manage- 
ment system, clause 4.3 - document control, 
clause 4.6 - external services and supplies, and 
clause 4.13 - quality and technical records (Table 
2). For technical requirements, they were clause 
5.3 - equipment, clause 5.5 - examination proce- 
dures and clause 5.6 - assuring quality of examina- 
tion results (Table 2). We believe that the common 
nonconformities encountered in assessments in 
Hong Kong are not unique to Hong Kong. Medical 
laboratories in other countries face similar difficul- 
ties in meeting the ISO 15189 requirements (2-4,11). 
The clause numbers that nonconformities were re- 
ported against could vary among different accred- 
itation bodies as very often, more than one ISO 
15189 requirements could be referred. For in- 
stance, lack of documented procedure could be 
reported against clause 4.2.1 where documenta- 
tion of all procedures and instructions are required. 
Similarly clause 5.5.3 also required all procedures 
to be documented and be available at the work- 
station for relevant staff. Where document control 
problems (clause 4.3) were identified, this could 
also be related to insufficient training for staff 
(clause 5.1) or poor implementation of the quality 
management system leading to misunderstand- 
ing among staff (clause 4.2). Hence for similar ob- 
servations, nonconformities could be categorized 
into different areas in different countries; this could 
be related to the training that the assessors re- 
ceived. A direct comparison of figures on noncon- 
formities reported by other accreditation bodies 



without knowing the details of the findings may 
not be appropriate. Requirements of ISO 15189 
give direction to the components of a good man- 
agement system that contributes to patient care. 
The more important is the understanding of the 
quality concepts behind the requirements and im- 
plement continuous improvement. 

When laboratories first established a management 
system according to requirements of ISO 15189, 
time is required for staff to buy in the idea of ac- 
creditation and to let themselves be familiar with 
the requirements. NCs were reported against is- 
sues of document control, use of obsolete docu- 
ments, or carrying out procedures not as docu- 
mented. This is understood as time is required for 
some laboratory staff to change their usual prac- 
tices; some still do not realize the usefulness of 
these requirements and consider them as only un- 
necessary extra work required by the accreditation 
body. Compliance with the technical requirements 
also improved as the knowledge of the laboratory 
personnel increased through exchanges with the 
assessors, through seminars and contacts with 
other accredited laboratories. This was indicated 
from the decrease in the number of NCs reported 
per laboratory assessed in 2009 when comparing 
with those assessed from 2004 to 2006 (6.6 vs. 
13.5), as well as significant reduction in the number 
of significant NCs reported in the same group of 
laboratories undergoing their second reassess- 
ments (Table 1 and 3). This is strong evidence that 
laboratories are improving as they try to comply 
with the requirements of ISO 15189. High number 
of NCs reported for the 12 laboratories undergo- 
ing initial assessment in 2009 reiterated the fact 
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that accreditation helps to point out the deficien- 
cies in laboratories and show their way for im- 
provement. 

Conclusion 

ISO 15189 is an accreditation standard developed 
particularly for medical laboratories. A manage- 
ment system in compliance with requirements of 
ISO 15189 helps laboratory to improve quality of 
its service. As evident from the reduction in 
number of NCs reported in reassessments, im- 
provement in quality of services resulting from ac- 
creditation becomes more apparent with time. 
Though the common types of NCs found in the 
two study periods are very similar, this did not in- 
dicate that laboratory personnel had not learnt 
from experience as detailed analysis of data col- 
lected in 2009 revealed that the number of NCs re- 
ported for each laboratory greatly decreased from 
initial assessments to reassessments/surveillance 



visits, thus showing that accredited laboratories 
are improving. Deficiencies of laboratories existed 
before accreditation, were pointed out in assess- 
ments and corrected, this led to general improve- 
ment in the quality of services provided. The ISO 
15189 standard is contributing to quality improve- 
ment. 
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Najcesce nesukladnosti koje susrecemo tijekom ocjenjivanja medicinskih 
laboratorija u Hong Kongu prema akreditacijskom standardu ISO 15189 

Sazetak 

Uvod: IS0 15189 je standard za akreditaciju medicinskih laboratorija objavljen 2003. Smatramo da je kod vec'ine laboratorija nekim zahtjevima 
standarda IS015189 posebno tesko udovoljiti. Cilj ovog clanka bio je iznijeti ucestalost pojava nesukladnosti sa zahtjevima akreditacijskog stan- 
darda IS0 15189 s kojima smo se susreli tijekom ocjenjivanja sukladnosti medicinskih laboratorija u Hong Kongu tijekom razdoblja od 2004. do 
2009. 

Materijali i metode: Nesukladnosti zabiljezene prilikom ocjenjivanja suglasnosti sa zahtjevima standarda IS0 15189 analizirane su u dva raz- 
doblja - u razdoblju od 2004. do 2006. godine i 2009. godine. Kategorizirane su prema brojevima zahtjeva standarda IS0 15189. Sukladnosti 27 
laboratorija prvotno su ocijenjene u razdoblju izmedu 2004. i 2006. te su ti rezultati usporedeni s ponovljenim ocjenjivanjem sukladnosti 2009. 
godine. 

Rezultati: Na podrucju zadovoljavanja zahtjeva koji se odnose na upravljanje, nesukladnosti su najcesce bile zabiljezene na podrucju sustava 
upravljanja kvalitetom, zapisa o kvaliteti i tehnickih zapisa te upravljanja dokumentima, dok su na podrucju tehnickih zahtjeva nesukladnosti 
zabiljezene kod postupaka ispitivanja, laboratorijske opreme i osiguranja kvalitete postupaka ispitivanja. Nije bilo velikih razlika u tipovima ne- 
sukladnosti zabiljezenih u dva razdoblja ispitivanja. Ukupan broj nesukladnosti zabiljezen u drugom ocjenjivanju 27 laboratorija 2009. godine bio 
je upola manji od ukupnog broja nesukladnosti pri inicijalnom ocjenjivanju sukladnosti. Broj statisticki znacajnih nesukladnosti po laboratoriju 
znacajnojesmanjen (P = 0,023). 

Zakljucak: Slicne su nesukladnosti zabiljezene u oba razdoblja, no smanjila se njihova ucestalost pojavljivanja. Statisticki znacajno smanjenje 
broja znacajnih nesukladnosti zabiljezeno kod iste skupine laboratorija u oba ispitna razdoblja dokazuje da standard IS0 15189 doprinosi pobolj- 
sanju kvalitete u akreditiranim laboratorijima. 

Kljucne rijeci: akreditacija; poboljsanje kvalitete; osiguranje kvalitete u zdravstvu; klinicka patologija 
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